A SMOOTHING ALGORITHM FOR THE 
SMALLEST INTERSECTING BALL PROBLEM 



Nguyen Thai An ^ and Nguyen Mau Nam^ 

Abstract: The Sylvester smallest enclosing circle problem asks for the smallest circle that encloses 
a finite number of points in the plane. Efficient algorithms for solving a generalized model of the 
classical Sylvester problem in which the given points are replaced by given Euclidean balls have been 
introduced and studied in the literature. In this paper, we present a fast numerical algorithm for 
solving another generalization of the classical Sylvester problem called the smallest intersecting ball 
problem which asks for a smallest Euclidean ball that intersects a finite number of convex sets. 
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1 Introduction and Problem Formulation 

The smallest enclosing circle problem asks for the circle of smallest radius enclosing a given 
set of finite points in the plane. This problem was introduced in the 19th century by 
Sylvester [10]. As one of the main problems of computational geometry, the problem has 
attracted great attention from many researchers. Current research focuses on developing 
fast numerical algorithms for solving the problem in large scale. In a recent paper, Nam et 
al. [6] proposed and studied the following generalized version of the smallest enclosing circle 
problem: given a finite number of nonempty closed convex subsets of a reflexive Banach 
space, find a ball with the smallest radius that intersects all of the sets. This new problem 
is called the smallest intersecting ball problem. Further generalized models of the smallest 
enclosing circle problem that involve both intersecting and enclosing generalized balls have 
been introduced and theoretically studied in [5]. 

In the general setting of [6], because of the intrinsic nondifferentiability of the data, the 
authors pursued the subgradient method to study the problem. It turns out that the 
subgradient method is applicable to a broad setting. However, the slow convergence rate 
prevents us from studying large-scale models. Our goal in this paper is to study the smallest 
intersecting ball problem in which the distance function is generated by the Euclidean norm 
of M". 

Let II • II denote the Euclidean norm in M". Given a finite number of nonempty closed 
convex sets for i = 1, . . . ,m, the mathematical modeling of the smallest intersecting ball 
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problem is 



minimize T>{x) := max{d{x; \ i = 1, . . . , m} subjec to x G M' 



n 



(1.1) 



where the Euclidean distance function to a nonempty closed convex subset Q C M" is given 



d{x; Q) := infjllx - q\\ \ q ^ Q}- 
The Euclidean projection from 2; to Q is 

V{x; Q):={qeQ\ \\x - q\\ = d{x; Q)}. 

It is well known that V{x; Q) is a singleton for every x S M". 

Since all the sets Vli for i = 1, . . . ,m are convex, the cost function T) is convex but nons- 
mooth. Moreover, problem (1) can be equivalently formulated as follows 



where 7 > 1. In this new formulation, each function ipi{x) := [d(x;r2i)]'^ is differentiable, 
but the new cost function T)^ is still nonsmooth. In the next sections, we only consider the 
case where 7 = 1 although it is possible to develop an analog with 7 > 1. 

In this paper, we apply the smoothing technique developed in [12] along with the MM 
Principle, see for instance [2], and the Nesterov smooth algorithm [7] to provide a fast 
numerical scheme that is applicable for the smallest intersecting ball problem that involving 
a large number of sets in high dimensions. 

If all of the target sets have a common point, then any point in common is a solution of 
problem (1), so we always assume that n"^;^ilj = 0. We also assume that at least one of 
the target sets fij for z = 1, . . . , m is bounded, which guarantees the existence of an optimal 
solution. These are our standing assumptions in this paper. 

2 Smooth Approximations 

For p > 0, the smoothing log- exponential function of D is defined as follows 



by 



minimize T)^{x) := max{[d{x;Qi)]'^ | i = 1, 



. . . , m} subjec to x G M' 



n 




i=l 



(2.2) 



where 



gi{x,p) = \/d(x;17i)2 +p2. 



Lemma 2.1 The function T)[x,p) has the following properties: 
(i) If X £ M" and < pi < p2, then 



D{x,pi) < D{x,p2). 
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(ii) For any x £ M" and p > 0, 

< V{x,p) - V{x) < p{l + Inm). 

(ii) For any p > 0, T>{-,p) is convex, coercive, and continuously differentiahle with the 
gradient in x computed by 

VV{x,p) = Y,^!^ {x -Xi) 



where Xi := and 

m 



1=1 



^ 9i{x,p) 



P 



t{x,p) 



Proof. The first and second assertion can be analogously proved as in [12]. For any p > 0, 
let ipi{x) = [d{x] fij)]^. Then Vip{x) = 2{x—Xi), where Xi = V{x; ilj). Since every projection 
mapping V{-;^i) is continuous, T){x,p) is continuously differentiahle as a function of x. 



The function fp{u) 



is increasing and convex on the interval [0, oo), and fij) is 
convex, so the function ki(x,p) = ^'■^^'^^ is also convex with respect to x. Take any x,y £ R" 
and A G (0, 1), by the convexity of the function x = {xi, . . . — )■ ln(^^j^ exp(2;j)), one 
has 



P(Ax + (1 — A)y, p) = In ^ exp 

i=l 

m 

< In exp 



1=1 



ki{\x + (1 - \)y,p) 
\ki{x,p) + (1 - X)ki{y,p) 



< 



my-. m 

A In exp I ki{x,p) j + (1 — A) In exp 

i=l ^ ^ i=l 

XV{x,p) + {I - X)V{y,p). 



ki{x,p) 



Thus, T){-,p) is convex. Using the standing assumption stating that at least one of the 
target sets is bounded, without loss of generality, we assume that is bounded. Then 

lim T>{x,p) > lim d{x;Qi) = oo. 
Therefore, 'D{-,p) is coercive. The proof is now complete. □ 

Remark 2.2 (i) In general, T){-,p) is not strictly convex. Indeed, in M^, we consider the 
problem with two target sets $7i = {—1} x [—1,1] and = {1} x [— Ijl]- Then V{-,p) 
takes constant value on {0} x [—1, 1]. 

(ii) If all of the target sets reduce to singletons, Vii = {q} for i = 1, . . . , m, one has 



V{x,p) = p In exp 



1=1 



9i{x,p) 
p 



3 



where gi{x,p) = ^/\\ 



X — Cj|p + p^-, and the gradient of V[-,p) at x becomes 



m 



><i{x,p) 
9i{x,p) 



VV{x,p) = Y, 



{X - Ci) . 



i=l 



From [12] it follows that is twice continuously differentiable and strictly convex. 

Moreover, for any p > 0, one has 



Consider the optimization problem 

minimize f{x),x G M". 

The main idea of the MM Principle is to find an appropriate approximation Ai of the 
objective function / such that 

M{x,x) = f{x) and f{x) < M{x,y) for ah x,y e M". 

Let J-^{x) the set of optimal solutions of the problem 

minimize A4{x, y) subject to y G M"", 

and call it the algorithm map. The MM algorithm is given by 

Xk+i = arg min^.A^(x,Xfc). 

Finding an appropriate majorization is an important step in this algorithm. It has been 
shown in [2] that the MM Principle provides an effective tool for solving the generalized 
Heron problem introduced in [4]. The key step is to use the upper estimate 



In what follows, we apply the MM Principle to solving the smallest intersecting ball problem 
in combination with the smoothing technique presented earlier. 

4 Applications to the Smallest Intersecting Ball Problem 

We would like to solve problem (1). In the first step, we approximate the cost function by 
the smoothing log-exponential function (2.2). Then the new function is majorized in order 
to apply the MM Principle. For x,y £ and p > 0, define 



W{x,p) - VV{y,p)\\ < -\\x - y\\ for ah x,y e M". 




3 The MM Principle 



d{x;Q) < \\x-Viy;Q)\\ and d{y;Q) = \\y-V{y;Q)\\. 



G{x\y\p) := piny ^ exp 



i=l 



m 



( 



p2 



) 
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Then G{x\y\p) serves as a majorization of the smoothing log-exponential function (2.2), and 
hence of the cost function of problem (1). 

Let us now present the MM smoothing algorithm for solving the smallest intersecting ball 
problem following the idea from [12]. 

MM Smoothing Algorithm. 

INPUT: m target sets Oj, i = 1, . . . ,m. 
INITIALIZE: a € (0, 1), yo e IR" and po > 0. 
Set k = 0. 
repeat 

Using a first order method to solve the problem 

min^gM"{G'(x|2/fc|pA:)} 
and denote its solution by Xk- 
Set pk+i = ap, yk+i = Xk- 
Set k:=k+l. 
until a stopping criterion is satisfied. 

To proceed, we present some basic concepts and results of convex analysis. A systematic 
development of convex analysis can be found, for instance, in [9]. Let / : R" — )• M be a 
convex function. For x E M", a suhgradient of / at j; is a vector v G M" that satisfies 

{v, x-x) < f{x) - f{x) for aU x e W. 

The set of all subgradients of / at x is called the subdifferential of / at this point and is 
denoted by df{x). 

From the definition, it is clear that / has an absolute minimum at x if and only if G df{x). 

Theorem 4.1 Let {xk}kLi sequence of exact solutions, x^ = arg min ^G{x\yk\pk), 

generated as in the smoothing MM algorithm. Then any limit point of {xk}^i is an optimal 
solution of problem (1). 



Proof. Let rr^, be a limit point of the sequence {x^}^^. Without loss of the generality, 
we assume that x^ — )■ x* as A; — )■ oo. By the definition, this also implies that — )• x^, as 
k — )• oo. Because x^ is a solution of the smooth minimization problem min2,gi8n G{x\yk\pk), 
one has 



'^G{xk\yk\Pk) = > {xk - V{yk\ ^i)) = 0, 

^ gi{xk,Pk) 

where gi{xk,Pk) = \/|kfc -V{yk]^i)\\ + {pkY and \i{xk,Pk) = e^p{9i{xk,Pk)/Pk)- Denote 
:= Xi{xk,Pk) and let the active index set at x^, be defined by 

lix*) := o G {1, 2, . . . , m} I (i(x*; ili) = P(x*) 
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We can rewrite A^^ as follows 



A 



,Pk)-goo{xk,Pk) \ ' 



with gooixkiVk) = | i = 1, . . . By the continuity of the norm function 

and the Euclidean projection mapping to convex sets, we have 



This implies 



lim gi{xk,Pk) = d{x^;ni),and lim goo{xk,Pk) = V{x^). 

lim Af = for i ^ I{x^). (4.3) 

By (4.3) and the fact that YJT=i>H = \^ > for ah A; e N and i G {1,2, ...,m}, 
the bounded sequence {Af}^^, i G /(x^.), has a convergent subsequence. Without loss of 
generality, we suppose that 

lim Af = A*, i e /(x*). 

Then Ylii^i(x,) ~ ^ ^"^^ -^i — ^ ^ I{x^). Take any i e I{x^), because the target 

sets are disjoint assumed by the standing assumptions, (i(x*;Oj) > and we have 

Xi ■■= lim -, ^ — = — -jj p-T — = dd{x^-ni). 

fc^oo gi[Xk,Pk) d[x^;ili) 

Thus, 

= lim VV{xk,Pk) = V X*x*. 

k—>-oo ^ — ' 

This is equivalent to 

G d'D{x^) = CO U {dd{x^; fij) | i G /(x*)}, 

which follows from a well-known sub differential formula for "max" function; see [9] . There- 
fore, X* is an optimal solution of problem (1). The proof is complete. □ 

5 Implementation with the Nesterov Smooth Algorithm 

Let / : M'" M be a C^'^ function such that 

|V/(x) - V/(y)| < £\\x - y\\ for all x,y £ W. 

For X E M", let 

T(x) := arg min y{Vf{x),y - x) + -||x - y\\^ . 

Let d{x) be a strongly convex function such that d{xQ) = and 

d{x) > - xof for ah x G W. 

To minimize the function / on M, the first order optimization scheme below was introduced 
by Nesterov in [7]. 
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Nesterov Smooth Algorithm. 



INPUT: /, L 

INITIALIZE: Choose xq G M". 
For A; > do 

Compute f{xk) and V/(xfc). 

Find Vk = T{xk). 

Find Zk = arg Ta.m.^{-d{x) + Ya=q — ^[/(a^i) + (V/(xi),x - Xi)]]. 

Set Xk+i = -r—^^k + TT^yk- 
fc + 3 fc + 3 

When adapting the Nesterov algorithm to the smallest intersecting ball problem, for sim- 
plicity, we choose d{x) = ||x|p, so(T = 2 and xq = 0. It is clear that 

T{xk) = Xk- Yl^^Uhl^ 

where i = 2 /p. Moreover, 

1 ^ z ~|~ 1 
Zk = -J^^-^f(^i)- 

i=0 

Let us present a pseudo code for solving the smallest intersecting ball problem. 
MM Smoothing Method with Nesterov Algorithm. 

INPUT: m target sets ilj, i = 1, . . . , m. 
INITIALIZE: a G (0, 1), yo £ M" and po > 0. 
Set k = 0. 
repeat 

Using the Nesterov iterations to solve the following with a stopping criterion 

min^gKn{G(x|yfc|pfc)}, 
and denote its solution by Xk- 
Set pk+i = ap, yk+i = Xk- 
Set k:=k+l. 
until a stopping criterion is satisfied. 
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